Receiving content prior to registration of a sender

ABSTRACT

The system may include a method comprising requesting, by a computer, a receiver identifier associated with a receiver; receiving, by the computer, the receiver identifier in association with content; constructing, by the computer, a URL link comprising access to DICOM viewer code, DICOM data for the selected images, a sender identifier and the receiver identifier; generating, by the computer, a notification to the receiver, wherein the notification includes the URL link; and transmitting, by the computer, the notification to a receiver based on the receiver identifier.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of, claims priority to and thebenefit of, U.S. Ser. No. 16/115,295 filed on Aug. 28, 2018 and entitled“CLOUD-BASED IMAGE ACCESS SYSTEMS AND METHODS,” The '295 applicationclaims priority to, and the benefit of, U.S. Provisional Ser. No.62/552,373 filed on Aug. 30, 2017 and entitled “Improved PACS Systemsand Methods.” The entire contents of both are hereby incorporated byreference for all purposes.

FIELD

The present disclosure generally relates to sending, receiving, andstoring medical images, and more particularly, to a cloud-based imageaccess system and related methods.

BACKGROUND

Medical images generated from a medical grade acquisition device are notformatted or transferred like digital pictures from a camera. They arestored and transferred in a file format called Digital Imaging andCommunication in Medicine (DICOM). Because all medical images closelyresemble each other, DICOM files provide extra security measures so thatpatient images do not get confused. The acquisition device, such as anX-ray or magnetic resonance imaging (MRI) machines, writes the patientand image data inside the DICOM file. The information is stored on theDICOM header located at the beginning of the file. Only specializedsoftware, which includes a DICOM viewer and picture archiving andcommunication system (PACS), can be used to transfer, view and storethese images. The DICOM viewer and PACS are fashioned in a client/serverrelationship. The DICOM viewer is used by physicians to visualize andmake diagnostic decisions and measurements. PACS are used to store andtransfer DICOM files from a server. The DICOM viewer cannot store theimages and the PACS do not have viewer capabilities. PACS are able tointerpret the DICOM file headers and pass most of the DICOM information(from the header) to a database for later retrieval. They then store theDICOM image to a local disk or Network Attached Storage (NAS). The priorart techniques and systems for sending, receiving and storing medicalimages are flawed for a multitude of reasons, which will be explainedbelow.

Sending Images Between Two Devices or PACS:

In order to send a DICOM image to another device, the sending devicemust have at least 3 identifiers regarding the destination in order tobe received by that device or PACS. Much like phone numbers that areseparated by country, area code and identifiers, the fields used inDICOM send are: the IP Address (e.g., 192.168.1.12), Port (e.g., 104),and AE Title (e.g., ACMEPACS).

The IP address is used to identify the device on a network. No twodevices on a network have the same IP address. The port identifies thesoftware instance on the device. No two applications listen on the sameport. The Application Entity Title (AE Title) identifies a subgroupingof the device's software, which is specific to the PACS on the machine.No two PACS can have the same AE Title and exist on the same machine andIP. Each of the identifiers described above are specific to the machine,software, and PACS instance. The DICOM send process is designed totransfer images between two facilities or PACS securely. It can takehours, or in some cases days, to get new PACS and devices to communicatewith each other. It often requires someone with knowledge of DICOM tomanage the transactions at one or both ends. The system is, for the mostpart, a closed communication system and requires outside communicationby the Administrators of each system. The three identifiers along withsecurity protocols are usually unique to each machine, office, server,and location, requiring communication to occur outside of the system.The current system also lacks the ability to send images to individuals,patients, users, or a machine that is unattended.

Viewing of the Images:

Typical PACS operate in a client/server configuration in which the DICOMviewer must be installed on a user's work station before images can berendered. This is very time consuming for deployment on a mass scale. Anadministration tool is required to grant users access to the databaseand file permission, which then will allow the application to query thedatabase for a list of images and relevant data for that user.

Extensibility and Modality Responsive:

Because traditional PACS/DICOM viewers need to be installed and upgradedmanually, they lack the ability to quickly respond to department or userneeds. Often a machine that is deployed (say cardiology) will not becompatible with another department (say orthopedics) because differentfeatures are required.

User Management and New Users of the System:

Traditional PACS have multiple layers of security that requirepermission editing. The network environment, the database, and filesystem permissions need to be correct before a user is able toeffectively view images. These often reside in separate managementsystems creating a burden on the users, administrators, and managementof care providers. There currently is not a way to get new users intothe system automatically. They must be manually input into each system.

Additional Data:

Traditional PACS and DICOM viewers lack the ability to introduceexternal data, such as pictures or PDF's, to a study or image set. Datain the PACS and viewer is typically limited to DICOM files and TEXT. Forexample, if a cell phone image needs to be stored with a study, itrequires external communication (e.g. email). This separates some of thedata from the DICOM files and database, and requires separateapplications (e.g. PACS and Email) for the user to be able to see allpertinent data.

Notifications:

Users are typically not notified by the viewing application when imagescome in from an outside source. Constant monitoring of the work list(list of studies) of the PACS is required by user to see that new imagesare in. PACS and viewers lack the capability to interface with an SimpleMail Transfer Protocol (SMTP) server or SMS (text) gateway.

User Delegation of Images:

Often a single AE Title may be used for an entire department or group ofusers. The AE Title is not specific to a user. Lacking within atraditional PACS is the ability to assign an image or study to anotheruser under the same AE title. To do so requires a specific rule becreated by the PACS administrator to delegate conditions. For example:all Mill images go to User A, and all Ultrasound images go to User B.

Fixed AE Titles:

AE Titles are dictated by the PACS administrators usually at the time ofset up, and are not easily changed. The DICOM sender MUST have thecorrect AE Title in order to successfully send images. If there is amiscommunication of the AE Title, when sending images between twodevices/facilities, the images will be lost. No resiliency exists, whichleads a very fragile transfer process.

Support of Cloud Services:

While cloud services continue to advance, tradition PACS lack theability to interface with these services directly. They often depend onthe service masquerading as a local service to the machine or network.They do not have the ability to adapt to services like Amazon S3 storagewhich uses a credential API to control. A 3^(rd) party application mustbe used to map a network drives and local resources to the cloudprovider.

Device Agnostic:

Due to the nature of the client-side viewer, the current workflow andarchitecture of PACS require multiple client-side applications based onthe OS (such as IOS and Windows) and department needs. If each versionof the client-side viewer is not maintained, it can introduce securityvulnerabilities and bugs. It is a constant challenge for the PACSadministrator to maintain the native viewers on each machine, as well asthe version specific to the OS.

DICOM Compliance at Browser:

Web based DICOM viewers exist but often require pre-processing of theDICOM image to a web compatible format such as Moving Picture ExpertsGroup (MPEG), Joint Photographic Experts Group (JPEG), or Audio VideoInterleave (AVI). This means users are viewing images that are not thesource DICOM file, and therefore lack the DICOM header information.Potential security issues exist due to the similarity of patient images.

Issuing CDs to Patients:

It is a standard practice for imaging centers to issue a CD of theimages taken to their patient for interpretation by a preferredphysician. Given this practice it is the patient's job to deliver theCDs to an interpreting physician for review. These CDs degrade over timeand can easily be misplaced or confused with older images.

Second Opinions by the Patient:

At times, a patient may want to request a second opinion. Theavailability of such field experts is typically inconvenient. With theinability of most patients to transfer image files over a cloud service,the CD of the DICOM files is mailed to the physician. Time is usually ofthe essence for studies such as this, and yet the patient is lacking auseful tool to help them seek out the best medical advice in a timelymanner.

Physician to Physician Consults:

Medical professionals often consult with their peers about certainstudies or cases to provide the best patient outcomes. This processintroduces an additional burden if DICOM images are involved. Setting upa DICOM send for a single study, if for example a physician works atHospital A and his peer works for Hospital B, is time consuming.Hospital B is not required to use company resources for suchtransactions and image storage. This often means the consultingphysician needs to use his own resources to view the images. Picturestaken by a cell phone of the DICOM viewer are frequently used betweenconsulting physicians. This has an obvious negative effect of thequality of the image.

Receiving Images from a Patient:

Image acquisition often happens outside the facility of thetreating/interpreting physician. The patient is given a CD of theirimagines by the imaging center. An appointment is then set up to reviewthe images with the patient in order to explain a treatment plan ordiagnosis. The imagines on the CD are typically not shared with thephysician until the time of the appointment, leaving the physician incharge of opening the DICOM files while the patient is in the exam room.This consumes valuable time for both parties and the facility, and israrely successful.

SUMMARY

The system may include a method comprising requesting, by a computer, areceiver identifier associated with a receiver; receiving, by thecomputer, the receiver identifier in association with content;constructing, by the computer, a URL link comprising access to DICOMviewer code, DICOM data for the selected images, a sender identifier andthe receiver identifier; generating, by the computer, a notification tothe receiver, wherein the notification includes the URL link; andtransmitting, by the computer, the notification to a receiver based onthe receiver identifier.

The content may be a medical image and the medical image may onlyviewable with DICOM viewer code. The notification may further include atleast one of a sender name or a description of the content. A sendername may obtained from a sender profile. The receiver identifier may beat least one of a receiver email address, receiver cell phone number ora receiver social security number. The method may combine notificationfunctions, DICOM functions, and/or browser-based encryption functions.The notification may comprise viewer application code, content to beviewed, an identity of the sender and an intended receiver. The methodmay send the notification through secure HTTPS. The method may send thenotification via transfer of non-compiled java and html code. The methodmay not require prior communications between the sender and recipient toovercome firewall and security settings.

The URL link may further comprise a description of the content obtainedfrom the DICOM header. The URL link may further comprise a descriptionof the content obtained from a description field and the descriptionfield may be populated by the sender.

The method may receive a request images instruction. The method mayreceive the receiver identifier from an image access system that iscapable of transferring files over DICOM protocol, in response to thesender not being registered. The method may receive an IP address andport number, in response to the sender not being registered. Moreover,the images may be held until the recipient registers.

BRIEF DESCRIPTION OF THE DRAWINGS

Many advantages of the present disclosure will be apparent to thoseskilled in the art with a reading of this specification in conjunctionwith the attached drawings, wherein like reference numerals are appliedto like elements and wherein:

FIG. 1 is an exemplary diagram illustrating an overview of an imageaccess system with unified communication of DICOM images, notifications,and secure file transfer according to various embodiments.

FIG. 2A is an exemplary diagram illustrating for comparison the requestand delivery of data and images using a traditional PACS and client-sideviewer (top half of FIG. 2A) and using an image access system accordingto various embodiments (bottom half of FIG. 2A).

FIG. 2B is an exemplary diagram illustrating the image access system inuse with a mobile device (e.g. mobile phone) to deliver the viewer andpatient data together specifically for mobile devices with an internetbrowser.

FIG. 3A is an exemplary diagram illustrating how the image access systeminterfaces with any of a variety of on-demand cloud service providers,including but not limited to SMS (text), data storage, email, anddatabase providers.

FIG. 3B is an exemplary diagram illustrating for comparison the priorart method of indirectly interfacing with cloud service providers viamiddleware (top half of FIG. 3B) and the improved method of directlyinterfacing with cloud service providers via the image access systemaccording to various embodiments (bottom half of FIG. 3B).

FIG. 4A is an exemplary flow chart illustrating how users of the imageaccess system may request images from a non-registered user according tovarious embodiments.

FIG. 4B is an exemplary flow chart illustrating how users use the imageaccess system to send DICOM images to a non-registered user according tovarious embodiments.

FIG. 5A is an exemplary diagram illustrating a data delivery method ofthe image access system using the AE Title to route images to theintended recipient according to various embodiments.

FIG. 5B is an exemplary diagram illustrating an image mapping method ofthe image access system using personal data to map images to therecipient according to various embodiments.

FIG. 5C is an exemplary flow chart illustrating the steps a traditionalPACS system process incoming DICOM files to accept or reject images.

FIG. 5D is an exemplary flow chart illustrating the steps the imageaccess system processes incoming DICOM files according to variousembodiments.

FIG. 5E is an exemplary diagram illustrating how the image access systemprocesses the AE Title for user contact information according to variousembodiments.

FIG. 6 is an exemplary diagram illustrating (by way of example only) ahost of individualized modules which may form part of the image accesssystem and which make it extensible to allow controlled user delivery offeatures specific for the user's requirements.

FIG. 7 is an exemplary diagram illustrating the feature of the imageaccess system of providing individualized viewing options based on userlogin according to various embodiments.

FIG. 8 is an exemplary flow chart illustrating one embodiment of theimage access system for delivering and receiving DICOM images accordingto various embodiments.

FIG. 9 is an exemplary diagram illustrating the feature of the imageaccess system of storing non-DICOM images to a patient study accordingto various embodiments.

FIG. 10 is a representation of an exemplary solution, illustrating thefeature of attaching non-DICOM data to an existing study according tovarious embodiments.

FIG. 11 is a representation of an exemplary solution, illustrating thefeature of DICOM and viewer downloaded to the browser according tovarious embodiments.

FIG. 12 is a representation of an exemplary solution, illustrating thefeature to send multiple images to multiple emails according to variousembodiments.

FIG. 13 is a representation of an exemplary solution, illustrating thefeature of requesting images from a non-registered user according tovarious embodiments.

FIG. 14 is a representation of an exemplary solution, illustrating thefeature to send a study to an email according to various embodiments.

FIG. 15 is a representation of image access software, illustrating theability to send to the solution by utilizing an email as the AE Titleaccording to various embodiments.

FIG. 16 is a representation of an exemplary solution administrationscreen, illustrating the feature of dynamic notifications to emailsaccording to various embodiments.

FIG. 17 is a representation of an exemplary solution administrationscreen, illustrating the log file of incoming studies and how iscommunicates with third party provider Amazon according to variousembodiments.

FIG. 18 is a representation of an exemplary solution, illustrating thefeature to upload DICOM images by the user according to variousembodiments.

FIG. 19 is a representation of an exemplary solution, illustrating thefeature of multiple incoming AE Titles for each user according tovarious embodiments.

FIG. 20 is a representation of an exemplary solution, illustrating themenu and work list of studies according to various embodiments.

FIG. 21 is a block diagram of exemplary computer systems forming part ofthe image access system according to various embodiments.

DETAILED DESCRIPTION

The detailed description of various embodiments herein makes referenceto the accompanying drawings and pictures, which show variousembodiments by way of illustration. While these various embodiments aredescribed in sufficient detail to enable those skilled in the art topractice the disclosure, it should be understood that other embodimentsmay be realized and that logical and mechanical changes may be madewithout departing from the spirit and scope of the disclosure. Thus, thedetailed description herein is presented for purposes of illustrationonly and not of limitation. For example, the steps recited in any of themethod or process descriptions may be executed in any order and are notlimited to the order presented. Moreover, any of the functions or stepsmay be outsourced to or performed by one or more third parties.Modifications, additions, or omissions may be made to the systems,apparatuses, and methods described herein without departing from thescope of the disclosure. For example, the components of the systems andapparatuses may be integrated or separated. Moreover, the operations ofthe systems and apparatuses disclosed herein may be performed by more,fewer, or other components and the methods described may include more,fewer, or other steps. Additionally, steps may be performed in anysuitable order. As used in this document, “each” refers to each memberof a set or each member of a subset of a set. Furthermore, any referenceto singular includes plural embodiments, and any reference to more thanone component may include a singular embodiment. Although specificadvantages have been enumerated herein, various embodiments may includesome, none, or all of the enumerated advantages. In the interest ofclarity, certain known features of an actual implementation may not bedescribed in this disclosure. The system may include compliance withsystem-related and business-related constraints, which will vary fromone implementation to another.

The image access system and related methods of the present disclosuremay take any of a variety of suitable forms, including (for example)proprietary computer software program(s) capable of operating on andcommunicating between any of a variety of suitable computer systems,databases, telecommunication systems, and the like as described hereinand/or readily ascertainable by those skilled in the art based oncurrently available or later developed technology. The software programforming part of the image access system allows any number ofstakeholders (e.g. patients, healthcare professionals, care-givers,family members, etc.) to enjoy and leverage a host of features andfunctionality which are improvements over the prior PACS system andtechniques. The improvements include, for example: 1. Storing andviewing raw scan data for medical diagnostic imaging that containsenhanced architecture conducive to improved communication methods andonboarding of non-registered users. 2. Delivery of viewing technology,patient data, and patient image data over internet connections utilizinga web browser application on any device, which enables rendering of theDICOM file directly on the web browser. 3. An extensible architecturefor image access that allows 3rd party cloud services to handle much ofthe workload independent from the platform. 4. Direct communicationbetween an image access system and 3rd party cloud service providersinstead of through middleware or security translation. 5. Enabling animage access system to have dynamic Application Entity Titles (AE Title)in order to route images to a specific users or login. 6. Enabling animage access system to process user data for use in the incoming AETitle for receiving medical images. 7. Enabling an image access systemto accept any image regardless of AE Title and route the data to a userbased on AE Title alone. 8. Enabling an image access system to acceptany image regardless of AE Title and hold the data until a user matchingthe AE Title has registered in the system. 9. Analyzing the incoming AETitle for communication data such as phone number or emails. 10.Requesting that medical DICOM images be sent to non-registered users.11. Transferring (sending) medical DICOM images to non-registered users.12. Delivering a customized user interface based on user type of animage access system user. 13. Indexing non-DICOM electronic material toa patient's study or image over a browser. 14. An extensible imageaccess system architecture conducive to cloud service providers, userlogin types, browser side DICOM rendering, and external communicationtypes such as email and SMS text. 15. Ability to send/request images,via DICOM protocol, to non-registered users based on the sender knowinga data point about the non-registered user (such as email or phone),which will eliminate the need for burning CD's and automates the dataneeded for device to image access system communication.

FIG. 1 is an overview of an image access system 10 with unifiedcommunication of DICOM images, notifications, and secure file transferamong a multitude of entities within the healthcare continuum, includingsystems, facilities, and users. Systems may include, for example,acquisition device(s) 12 (e.g. MM, CT, and X-Ray systems) for generatingdigital images of a patient and image access system(s) 14 formaintaining image archives and communicating images to other locations.Facilities may include, for example, a primary healthcare facility 16(e.g. office, clinic, or hospital where a patient goes to obtain primaryhealthcare services, such as primary physician visit) and a secondaryhealthcare facility 18 (e.g. office, clinic, or hospital other thanprimary healthcare facility where the patient goes for secondary care,such as second opinion, surgery, etc.). The primary healthcare facility16 and secondary healthcare facility 18 may be part of the samehealthcare system (e.g. hospital chain, etc.) or part of separate anddistinct healthcare systems. Users may include, for example,unregistered users 20, patients 22, and healthcare providers 24.Unregistered users 20 may include, for example, individuals, businesses,or groups who have not created a login to access and use the imageaccess system. Healthcare providers 24 may include, for example, generalpractitioner physicians, surgeons, physician's assistants, schedulingcoordinators, nurses, etc.

The image access system of the present disclosure enables robust andconvenient communication amongst the various entities throughfunctionality including, for example, notifications (e.g. SMS text,email), secure file upload/download, and DICOM send/receive as shown inthe boxed legend of FIG. 1 . In various embodiments, the image accesssystem may employ known in the art secure file upload/download and knownin the art DICOM send/receive functionalities between and amongst allthe entities in the continuum, while the notification functionality maybe employed for all except the acquisition device(s) 12 and image accesssystem(s) 14. The various communications and functionalities within theimage access system 10 may be provided with any of a variety ofcurrently available or later-developed encryption techniques or tacticsto help prevent unauthorized access to the system and any data (inmotion and/or at rest) and communications associated therewith.

The image access system allows any entity to send/receive DICOM filesautomatically with limited input from users or image access systemadministrators. This has been impossible in prior art image accesssystems because the prior art systems are only designed to send betweentwo PACS software programs (PACS to PACS, see, e.g. FIG. 5C). Patientssimply do not own PACS software so giving them the ability to send orreceive their images was previously impossible. The image access systemeliminates or reduces the need to burn and mail DICOM images on a CD topatients, doctors, or care providers. By combining notifications, DICOMfunctionality and browser-based encryption, each entity can send to anyother entity (e.g., in the diagram of FIG. 1 ). More particularly, thefunctions of notification, DICOM functions, and browser-based encryptionare combined by sending the viewer application code, the data to beviewed, and the identity of the sender and intended receiver throughsecure HTTPS transfer of non-compiled java and html code. The solutionalso accommodates unregistered users by invitation over a notificationsystem. As such, the DICOM software and/or viewer does not need to beinstalled on the client system. The DICOM software and/or viewer may beembedded in a webpage and opened in a browser by the client system.

The largest obstacle in sending images to another location viatraditional PACS is the constant need of prior communications betweenserver administrators, on each end, to navigate firewall settings andsecurity before a send can be completed successfully. The image accesssystem of the present disclosure overcomes this limitation by usingpersonal identifiers (frequently known by the sender, such as email orphone number—per FIG. 5A) such that the sender and the receiver do nothave to communicate outside of the image access system prior to imagesbeing sent. All data traffic is conducted on a commonly open firewallfor web browsing and email. The following examples illustrate commonsituations where the image access system overcomes the limitation of theneed for prior knowledge of static communication values.

Example 1. If a registered physician would like to send DICOM images toanother physician who is unregistered, the sending physician simplypresses send next to the images to be sent and enters the receiver'semail address that is requested by the system. Once the physician entersthe receiver's email address and selects ok, the image access systemconstructs a unique and secure url link that is capable of providingaccess to and/or delivering DICOM viewer code, DICOM data for theselected images, and identity information for the sender and intendedreceiver. The solution then generates an email to the recipient(receiver) stating the senders name, a description of the images, and aunique url link for accessing and viewing the images. The system managesthe permissions for receiving the notification and accessing the link.The system determines who to send the message to. The sender name may beobtained from a sender profile associated with a sender account. Invarious embodiments, the user account may need to be logged in, in orderto obtain the sender name. In various embodiments, the description ofthe images is obtained from the DICOM header, if a description isincluded. In various, embodiments, a description field is offered to thesender, for example, along with the field allowing entry of thereceiver's email address.

Example 2. If a registered physician would like to send DICOM images toanother physician who is unregistered, the sending physician enters thereceiver's cell phone number and a SMS Text message will be sent to thereceiver with the similar information contained from Example 1.

Example 3. The reverse problem exists when a physician would like toreceive and view images, but lacks the ability to contact the potentialsender. This happens frequently in the medical specialty of orthopedics,where a patient oftentimes needs to schedule an appointment for the solepurpose of delivering a CD containing their images so the orthopedicsurgeon can review them for diagnostic or second-opinion purposes. Thephysician is then tasked with loading the images into a viewer while thepatient is waiting. The image access system allows the physician torequest images from the patient prior to the appointment.

The physician simply selects “request images” from a drop-down menuwithin the software of the image access system and enters the patient'semail address. The image access system generates a request for imagesemail giving the user instructions how to send the requested images fromany computer (a CD drive may also be used to upload the images). Theimage access accomplishes this by including in the image request email aunique url link that associates DICOM images sent following that link tothe requester's account. The image request email also contains uniqueDICOM communication settings for the requester's account should therecipient of the request chose to send the images using DICOM protocol.

Example 4. In various embodiments, the above examples have one user(sender or receiver) registered, but the image access system goes a stepfurther in allowing both parties to be unregistered users at the timeimages are sent over DICOM protocol, as illustrated in FIG. 5D. Forusers to send images without registering, in various embodiments, thesender uses an image access system that is capable of transferring filesover DICOM protocol.

The sender simply types in the IP and Port number of the solution, andthen enters a personal identifier of the recipient (such as a cell phonenumber). The images are accepted and held in the image access with astatus that indicates that the recipient and/or sender does not have aregistered account associated with the recipient until the recipientand/or sender registers with a matching identifier (e.g. cell phone,email, etc. . . . ). Upon new account registration, the purgatory listof images is checked for matching credentials. In various embodiments,the act of registration causes the image access to look for matchingcredentials. In various embodiments the image access uses a timer tocheck periodically. If matched, the status of the purgatory images areset to claimed and viewable by the account holder. In variousembodiments, the image access uses verified email addresses and mobilenumbers to qualify matching credentials or any established set ofverifiable criteria can be used. The image access system goes yetanother step further to deliver hands free administration. The imageaccess system includes functionality capable of recognizing the personalidentifier being input by a user and sending a notification to the userinforming them of the existence of images previously loaded into theimage access system, potentially prior to their registration. In variousembodiments, the act of a personal identifier being input would triggerthe image access to look for existing images associated with thatidentifier. In various embodiments, the image access may use a timer toperform this check at intervals. This is depicted in FIG. 5D. This isespecially useful for imaging centers, which only do image acquisitionand thus are limited to transporting images via image access system toother locations or providing the patient with a CD. With the advent ofthe image access system of the present disclosure, imaging centers willhave the ability to send all images to the image access system using anemail address or cell phone number as opposed to using the AE Title(employed in the prior art PACS systems). The image access system doesthe remainder of the work, allowing the recipient to electronicallyreceive, view, save, or forward on the images for additional review.

FIG. 2A illustrates for comparison the request and delivery of data andimages using a traditional PACS and client-side viewer (top half of FIG.2A) and using the image access system 10 of the present disclosure(bottom half of FIG. 2A). The traditional PACS system includes ahardware-based PACS on a server 30 communicatively coupled to ahardware-based drive 31 and PACS database 33, as well as a client-sideviewer 32 installed on a computer 34 that is on the same local areanetwork (LAN) 36. Upon initiation by a user (e.g. computer keystroke,mouse click, etc.) the viewer 32 sends a query to the PACS database 38for requested patient records and images. The requested patient recordsand images are then transmitted back to the viewer 32 and then displayedto the user on the computer 34.

As shown on the bottom half of FIG. 2A, the image access system 10provides a more flexible work environment for viewing images securelyacross a local area network (LAN) and/or a wide area network (WAN) bydelivering the viewer, data, and images together. The image access'sviewer requires no installation and is sent to the browserpreconfigured. An interface is presented to the user and DICOM data isstreamed, from storage, to the viewer. This process is in contrast toprior art systems that require installation and configuration prior touse.

The image access system 10 may be run on either a cloud-based serviceand/or installed on hardware-based networks (LAN or WAN) within ahospital. Upon initiation by a user (e.g. computer keystroke, mouseclick, etc. . . . on the computer 34), a HTTPS request is sent via thebrowser on the computer 34 such that it can bypass any firewall, via apublic port, employed as part of the LAN or WAN. The viewer 40 used withthe image access system 10 and the requested patient data 42 (e.g.records or images located on the LAN or WAN) are rendered in the imageaccess system 10 then delivered together to the user device over HTTPS.In this manner, the image access system 10 is very resilient and candeliver the viewing technology, along with the images, to any browseraccessible around the world. This is especially important in the medicalfield where patients are often in remote areas far from specialtyphysicians who are spread throughout the world.

FIG. 2B illustrates the image access system 10 in use with a mobiledevice 40 (e.g. smart phone, tablet computer, laptop, etc.) to deliverthe viewer and patient data together specifically for mobile deviceswith an internet browser. Upon activation by the user of the mobiledevice 40, an HTTPS request will be transmitted wirelessly (e.g. viacell tower, WIFI, satellite, etc. . . . ) to the image access system 10which will render the requested patient data 42 and then deliver alongwith the viewer 40 to the mobile device 40 user device over HTTPS. Bydelivering the viewer, images, and patient data together, the imageaccess system 10 allows any device with an internet browser to accesspatient images without a preinstalled client application. The viewer anddata can be downloaded over cell phone or satellite data communicationlink. Using advanced programming methods in Java Script, the solutionconverts the pixel data and DICOM information to raw pixel data andreadable text in the browser. The system stores the pixel datatemporarily in the browser's memory and renders it on the screen (e.g.,in java script), thereby tricking the browser into believing it is anative image. This is important because it is “read only” access anddoes not alter the DICOM file(s). Altering the DICOM files on theserver, for example, would create a central point of failure and doesnot follow the “Chain of Custody” demands of many health care providers.If a server-side application where to convert the DICOM data, then twocopies of the same images would exist—one in DICOM (the original) andone for web compatibility (for viewing over the web).

FIG. 3A illustrates how the image access system 10 integrates directlywith cloud-based service providers to allow extensibility, scaling, andmore efficient delivery of services such as messaging. The image accesssystem 10 may be installed on any of a variety of computers systems,including (for example) desktop computers, laptop computers, networkcomputers, virtual computers, mobile devices, etc. . . . The imageaccess system 10 may be used with any of a variety of currentlyavailable or later-developed cloud-based services, including (forexample) Amazon, Google, etc. The type of cloud-based services mayinclude, for example, SMS/text 44, data storage 46, email 48, anddatabase 50 capable of generating the respective service output, namely,SMS/texts 52, data 54, email 56, databases 58. The extensibility enabledby cloud-based services allows the image access system 10 to overcomeissues with local and regional internet service providers (ISPs). Forexample, many ISPs block or forbid sending mass email volumes in aneffort to prevent SPAM. The image access system 10 does not need toadhere to the terms of service because it can use a third-party providerto send outgoing mail. In other words, in various embodiments, thesystem bypasses local or regional ISPs because the server software iscloud based and can utilize any email provider directly. Bycommunicating over application programming interface (API), the imageaccess system 10 is able to send the data to the cloud-based serviceprovider for the provider to send the data out. Traditional PACS systemsare not extensible because they operate on a firewalled LAN. Incontrast, the system may rely on third parties to provide hard drivestorage, notifications, SMS, and authentication. An example of emaildata may look like this:

API User: switchpacs API Key: 1234ABCD5678910 { “data”: [{ “type”:“email”, “id”: “1”, “attributes”: { “title”: “You have received medicalimages from $sender!”, “body”: “$User has sent you medical images. Toview them click here .”, “created”: “2016-05-22T14:56:29.000Z”,“updated”: “2016-05-22T14:56:28.000Z” } } }],

Through the use of the image access system 10, this script may be passedto the third-party via the internet (http:// or https://) such that thethird-party can process and parse the data as it relates to delivery toa user. The third-party can then route and deliver the messages to theappropriate individual as an outgoing email. The data is then generatedby the third-party as email and sent out, as opposed to using the ISPthat the image access system 10 is hosted on.

FIG. 3B illustrates for comparison the prior art method of indirectlyinterfacing with cloud service providers via middleware (top half ofFIG. 3B) and the improved method of directly interfacing with cloudservice providers via the image access system 10 (bottom half of FIG.3B). Traditional hardware-based PACS 30 include a mapped drive 60 whichmakes the cloud service 62 appear as a local disk to the serverhardware. While they are able to integrate with cloud service providers62, it requires translation software (e.g. middleware 64) to dotranslation or authentication conversion to adapt to the cloud service62.

The image access system 10 has the settings built directly into theapplication that talks with the data and the authentication protocolsdirectly without the need for middleware. More specifically, withreference to the bottom half of FIG. 3B, the image access system 10 caninterface with the cloud storage provider service 62 (e.g. Amazon S3 byway of example only) and includes embedded security information 66within the software of the image access system 10. The image accesssystem 10 uses the data-storage resources of the cloud-based service 62to send data to the user's browser. In so doing, the image access system10 provides a virtually unlimited data storage capacity via thecloud-based service provider 62. The embedded security information mayinclude, for example, every time a connection is made with a third partyAPI, credentials are passed and verified. For a traditional PACS toextend storage to the cloud, it must “trick” it's host server intobelieving it has a large hard drive. This is commonly known as “DriveMapping”. Middleware must be used to pass the API credentials to thestorage provider to store the data.

FIG. 4A is an exemplary flow chart illustrating the process of aregistered user requesting images from a non-registered user. Users mayinclude, for example, individuals or groups of users, already registeredin the system. Non-registered users may include for example, anyindividual who is not currently registered in the system.

In the presented scenario, the process starts with the user registering(e.g. creating an account.) or logging in to the interface 68. Theinterface is, for example, a web page or user interface on a device(i.e. mobile phone, laptop, workstation, etc). The image access systemthen has an interface for the user to request images. In variousembodiments, the software is delivered via a browser. The user is ableto type an identifier (e.g. cell phone, email, etc) of the intendedreceiver into the interface 70. The receiver is, for example anindividual, care provider, physician, or group of users that may or maynot be registered in the system. A notification is generated and sent tothe recipient 72. In various embodiments, this is done via a third-partyemail or SMS solution. In various embodiments, other email or SMSdelivery methods may be used. The image access determines the method ofcommunication (either email or SMS) by reviewing the supplied identifierand using logical routines. The notification contains, for example, theRequestors (e.g. asking user) AE Title(s) and/or a unique URL (link) forthe recipient to upload images. In various embodiments, any data can bepart of the AE Title such as, for example, text number, email address,etc. (in contrast to prior PACS systems that require the AE Titles tomatch exactly). The system can then automatically recognize the port andIP address. The recipient receives the notification 74. The recipienthas the choice to upload or send images via DICOM protocol 76. If therecipient chooses to send via DICOM protocol, then they send the images,from their device or image access system, to the Requestors informationsent through the notification 78. The recipient may choose based ontheir experience and allowed access. For example, an image access systemadministrator may choose to send via DICOM send because they haveauthority and it is easiest for the administrator. An office worker maynot have the same access and then will likely choose the included linkto the upload page. To upload the files over https://, the recipient mayfollow the unique URL link supplied in the notification requesting aregistration to the system 84 (link included in the image requestemail). Once registered, they have the ability to upload the images 86to the requestors' account 80. A notification may or may not be sent tothe requestor 82. In various embodiments, the unique URL directs theuser to an interface to upload images without requiring registration.

This process can be used in many circumstances, for example, such as:

-   -   Doctor (user) 24 requesting images from patient 22    -   Patient (user) 22 requesting images from a Care Provider 16    -   Hospital (user) 16 requesting images from another Care Provider        18

By using generated dynamic notifications 13, the image access system 10,automatically delivers instructions how to send images to the requestor.Instructions include, for example, in the form of written text and/orcombination of media (such as pictures and movies, directions for anindividual to follow for the purpose of completing a task. Theinstructions contain, for example, how to transfer via secure fileupload 15, user specific DICOM information, and other transferinformation. The email, or SMS text, consists of information aboutrequestor and specifies what images they are looking for. For example ifHospital A 16, is registered in the solution, and needs images fromHospital B18: Hospital A 16 clicks on “Request Images” and entersHospital B's 18 email. Hospital B 18 receives an email or text, similarto: (for example). (System variables are in [brackets]):

To: hospitalB@domain.com[recipient]

From: email@solution.com[solution]

Subject: Hospital A [requestor] has requested images from you

Body: Hospital A [requestor] has requested images from you regarding:Patient Jane Doe, CT that was taken on or around 1/1/2001[description ofimages]. To send these images upload to http://[solution]/[unique url].Alternatively, Administrator may do a DICOM send Operation to:

IP: 123.123.123 [solution IP Address]

Port: 105 [solution Port number]

AE Title: HospitalA@domain.com[email AE Title of requestor]

OR

AE Title: 9876543210 [phone AE Title of requestor]

The above email is sent to the intended recipient with instructions tocomplete a send operation to HospitalA.

FIG. 4B illustrates the process of a user sending images to anon-registered user. The sender must login or create an account in thesystem 68. Once logged in they choose the images they would like tosend, from the works list, and select “Send”. The sender is prompted forthe recipient's email or phone number 70 within an interface dialog. Thenotification is generated containing a unique URL (link) 80 A new linkmay be generated for each send, wherein the link is unique for thatspecific send of images, and the receiver gets the notification 74. Thereceiver then clicks on the URL to be taken to a special registrationpage. When registration is completed 84, the receiver is able to viewthe images 90. The url is a link that displays the viewer and populatesit with appropriate data and images.

This process can be used in many circumstances for example:

When a patient (user) wants a second opinion from a doctor

When a doctor (user) want to consult with a colleague about patientimages.

When a Doctor or Patient (user) wants a specialist to view images fordiagnostic purposes.

For example if Hospital A 16, is registered in the Image access System,and wants to send images to Hospital B18: Hospital A 16 clicks on “SendImages” and enters Hospital B's email. Hospital B 18 receives an emailsimilar for example: (solution variables are in [brackets]):

To: hospitalB@domain.com[recipient]

From: email@solution.com[solution]

Subject: Hospital A[sender] has images for you to review

Body: Hospital A[sender] has sent you images: To view these images go tohttp://[solution]/[unique registration url].

The above email is sent to the intended recipient. The link sends theuser to a unique registration page. After filling out the registration,the user is redirected to viewing of the images.

FIG. 5A illustrates a flow chart for a new and improved approach toreceiving medical images over DICOM protocol from an image access systemor Device. This includes for example a LAN or WAN connectivity. Insteadof the receiving AE Title being preconfigured and static on thereceiving side (FIG. 5C), the Image access System 10 is able to receiveimages directly 98, to a user's account 102, by analyzing the AE Title98 The database may hold user data. The AE title may be used toassociate the image to the account for user specific data. When sendingimages from an image access system or Device 92, the administrator isrequested to enter 3 variables about the receiving image access systemor Device: IP Address 94, Port 96, and AE Title 98. The Image accessSystem queries the database for unique personal data points of a user'saccount, in order to route the data appropriately 100. In variousembodiments, the query is completed in response to a new user signingup. In various embodiments, a timer controls this process at periodicintervals. This is vastly superior to previous PACS methods of havingstatic AE Titles.

Each user on the solution has a number of personal identifiers such ascell phone, email, username. As long as the personal identifier isunique to the user it can be utilized. The personal identifier may besomething less public like patient ID or Social Security Number. Havinga less public identifier increases the security of the solution so thatonly the two parties (sending and receiving) know the identifier. Forexample if an imaging center would like to send images to a patient,using the Image access System, they might use the patients SocialSecurity Number. As long as the receiving user fills in the SocialSecurity Number correctly, they will receive the images to thecorresponding account. A flow chart demonstrating this is FIG. 5D. Inthis example, your SSN, nickname, and a personal code may be stored in aprofile with your email provider. When someone sends an email to yourprovider, but doesn't use your email address, they instead use your SSN.The email provider may route the message to your account because theymatched the SSN to your profile.

FIG. 5B illustrates how the solution determines multiple identifiers forusers in respect to incoming images over DICOM protocol from anacquisition device or image access system. In the illustration, theimage access system identifies Email 107, Cell Phone 108, and SocialSecurity number 110 to be unique to the individual user The system maydetermine the data to be unique because the database may have uniquekeys that cannot be associated to multiple accounts which may indicatethe data is unique. These data points are entered at the time ofregistration 104 on the image access system. The new identifiers arestored to the image access system database in a table reserved for AETitles 112. These entries 112 are used by the system 10 to “listen” 116for incoming images 114 that have the AE Title with the same characters.The system performs a handshake but only on preconfigured ports withmessages that meet the preconfigured AETitle. Existing systems may havea predefined list of AE titles to accept. The improved system may listenfor more than just an AE title on a given list. The system may acceptthe AE title and then compare it to any existing title to determine thatit is “new”. The characters may be an exact match of the user data orvariance of (capitals, symbols, etc) Incoming DICOM files will be storedto the user account 118 that match ANY of the single data points 112.For example, a mobile number may be entered with or without dashes or aleading country code, and the image access will determine the base ofthe mobile number to use in various embodiments to match an account.This provides the ability for care providers or anyone, who may have apatient's cell phone number, the capability to send images to thespecific patient securely. The solution uses a database table of AETitles, that commonly take the form of, for example, common text,numbers, email address, phone number, or any combination of numbers andletters, to automatically match users to incoming images. A databasetable may be used to perform the checking for duplicate identifiers at apace consistent with current communications protocols. For example; ifuser Jon Doe signs up for the solution and enters his social security as123-45-6789 (9 digits) and Jane Doe signs up incorrectly with a cellphone number of 123-456-789 (the same 9 digits) the solution may quicklytell Jane Doe that the number entered already exists in the solution.However Jane Doe may use 123-456-7891 (10 digits) as her cell phone andstill be a unique identifier.

FIG. 5C illustrates a comparison of how images are received on aTraditional PACS vs the image access system.

A major drawback of a traditional PACS is that it may reject images withan AE Title that does not match any of the predefined AE Titles. In atraditional PACS, first the DICOM Receiver accepts the incomingconnection on the correct IP and port number 120. Following, the DICOMreceiver then checks to see if the AE Title, of the incoming images,matches the configuration set in the PACS software 122. Theconfiguration set is normally defined by the software vender and thePACS administrator or between two PACS administrators. Thisconfiguration set is predefined and agreed upon by both parties before asuccessful DICOM transmission can occur. This requires some type ofcommunication outside of the PACS (email, phone call) between bothparties in order to agree on the configuration set. If the AE Title doesnot match, they are rejected and not stored or registered in thedatabase 124. If the AE Title does match, it is stored to the filesystem and records are created in the database 126. Users are then ableto find the images by doing a database query from their clientapplication.

FIG. 5D illustrates an even further improvement of the image accesssystem, over previous PACS, by accepting all images and doing analysisof the AE Title to proactively send notifications to non-registeredusers. When images are sent from a device or image access system theyare received, on the image access system, by the DICOM receiver 120. Asin previous illustrations, the receiver determines if the AE Titlebelongs to a registered user 122 by querying the AE Title Table 112. Ifa similar match is made, then that system assigns the images to thecorresponding user 124 thus allowing for user access to the images 126,as user access to images is controlled by a positive conditionalmatching status within the database records. If the exact matching AETitle does not already exist in the image access database, the imageaccess system analyzes the characters of the AE Title provided forpatterns matching, for example, email or cell phone 128. If the AE Titleappears to be a cell phone or email (e.g., based on a serious of logicaloperators that analyze the characters to determine the formatcorresponding to an email or cell phone number), the system routes it tothe corresponding notification module 134. If the AE Title does notappear to be a cell phone or email: The image access system holds theimages and waits 130 for an event 132 (e.g. new user registration ortime delay), to query the AE Title table, for matching user data. If nofields match the incoming AE Title 122 the images are held indefinitely.This creates a more resilient solution that doesn't require anyregistration for the receiving party. The image sender can send imagesfirst, using DICOM Protocol, to initiate the workflow. For example: AnImaging Center 16 may acquire patients' images through an acquisitiondevice 12 and DICOM send, to the image access system 10, using thepatient's email address. The sending of images can happen immediatelyeven while the patient is in the room. The solution will hold the imagesuntil the user registers.

FIG. 5E is an illustration of how an unregistered patient is able toreceive images, using email notification, from an outside source(registered or unregistered) via DICOM protocol. This elaboratesslightly on FIG. 5D in that it depicts an additional step of sending anemail 56 to the unregistered user 20.

When images are sent from a device or image access system over DICOMprotocol 17 they are received, on the image access system 10, by theDICOM receiver 116. As in previous illustrations, the receiver,determines if the AE Title 132 belongs to a registered user 122 byquerying the AE Title Table 58. If the AE Title does not exist, theimage access system analyzes the characters for patterns matching, forexample, email or cell phone 128. If the AE Title 132 does appears to bea cell phone or email, the system routes it to the correspondingnotification module 134. In the illustration, the AE title 132 is anemail, so communicates with the outgoing mail provider 56 to send anotification to the unregistered user 20. If the AE Title 132 does notappear to be a cell phone or email: The image access system saves theimages and waits 130 for an event.

This work flow allows for dramatically easier operation of sendingimages between two parties with little or no supervision of an imageaccess system Administrator (e.g. someone versed in the operation ofPACS)

For example: An Imaging Center 16 may acquire patients' images and DICOMsend, to the image access system, using the patient's email address. Thesending of images can happen immediately even while the patient is inthe room. The image access system will hold the images AND send an emailto the patient. It does not require the patient to register prior to theimage acquisition appointment.

FIG. 6 is an illustration of the architecture of the image access systemand its utilization, for example, of application programming interfaces(API's) to receive/write data on the server side 136 and dynamicallydisplay data to the users client side 142. The image access system hasthe ability to interface with data sources, for example, HospitalInformation System (HIS) and HL7 protocols 136. Features 140 such asreporting, measurement tools, and billing can be generated, on the imageaccess system, to the users specific permissions, needs, or profile typeof the user 142. The final output is specific, but not limited to, usersrequirements, login type, or permissions 142.

For example a Patient might require a different user interface than aCardiologist. User types are not new to software applications but it isdefinitely advancement to existing PACS technology. In existingtechnology, differing types of interface needs are handled by the clientapplication installation. Switching user interfaces often means manuallyinstalling another application on the user's computer. By using thebrowser, in the image access system, to download the viewer 40 and data42, the interface can be customized each time it is downloaded.

FIG. 7 Further elaborates on FIG. 6 to show the customized display tothe user type from the image access system 10. It illustrates visiblemodules of the application that are rendered on the server, and sent tothe users interface, after login 144. The image access system 10 is ableto render the interface to the service customized to the users' profiletype, login, or permissions.

The customized user interface is presented to the user. In this case aRadiologist (User B) 148 and a Cardiologist (User A) 146. User A andUser B require different measurement tools and features 150 & 152.

FIG. 8 is high level flow chart of, for example, how the various modulesand features may be configured together to provide a service forsecurely sending and receiving DICOM files, notifications, reports, andpatient data.

The solution allows two entry points 152 to accommodate unregisteredusers. The non-registered users use a DICOM send operation to interfacewith the system. Other types of transfers over https (“sending of image”FIG. 4B, or “request images” FIG. 4A) at least one user is registered tocomplete the task.

The image access system's key features are, for example, a simplifieduser interface for finding images quickly through a list (specific tothe user) presented to the user through a web interface 154 (FIG. 2A),the ability to view images specific to the user, received from otherusers 160, the ability to request image from anyone 158 (FIG. 4A), andsend images to anyone 156 (FIG. 4B), with little or no administration orcommunication. The image access system analyzes the incoming AE Title(FIG. 5E) to figure out how to communicate and notify the end userautomatically.

FIG. 9 is an illustration of the ability to store, and index, non-DICOMrelated media and files, to an individual study or image in one aspect.This may contain, for example, PDF(s), moving image(s), picture(s), andtext. The various aspects include, for example, the patient table 160were it has a relational database connection (one to one or one to many)to the studies table 162. The studies table may contain list ofindividual images or collection of images to the patient table 160. Theattachment table 164 contains documents or files, pertaining to theselect study or images table, in a one to one or one to manyrelationships in the database. The relationship may also be indexedusing non-relational databases (e.g. Mongo DB, and other “No SQL”applications for data processing) The image access system delivers thepatient specific study or study specific images to the user via theviewer 40. User is presented with the ability to upload documents,files, and text 166 to the image access System through the interface.The image access's ability to associate uploaded items (e.g., documents,files and text) to a table structure provides greater flexibility incollection and communicating of the combined content of the viewer,images, and associated data. This structure is superior to simple singleassociations (e.g., as in an email attachment) in that any combinationof index or indexes may be used to collect the components for viewingthe data and image. This becomes important when non-DICOM informationand files needs to be used to make a diagnosis. For example if a patienthas a cell phone video of how an injury effects patent movement. Thistype of observation is usually an observation of a physician or healthcare worker. The ability to append this data also opens upbi-directional communication between two remote parties such as patientand doctor.

FIG. 10 is a representation of the web user interface to the imageaccess system 10. It is one graphical representation of the ability toattach non-DICOM file(s) to a single or multiple DICOM image(s) furtherdescribed in FIG. 9 . The graphical representation is not necessarilylimited to, a web interface. The representation demonstrates therelationship to the patient table 160 and the viewing of patient imagedata 41 and viewer 40. The ability to upload from a user's localcomputer or device from storage is handled through the “choose file”button 170 were the user must select the file(s) according to variousembodiments. By selecting the file(s) the user initiates an upload tothe server. The image access system 10 sends the file to storage andwrites the location, date, and additional information to the systemsdatabase. Then is indexed to, for example, the table(s) image, study, orpatient. Any combination of indexing to the image, study, or patient tothe attachment may be used. The image access ability to index non-DICOMfiles to single or multiple DICOM images provides for collecting of allreferences to the DICOM files and communication of these references, forexample access through a unique URL link for viewing. FIG. 11 is arepresentation of the web user interface to the image access system 10.It is one graphical representation of the ability to send image data,patient data, and DICOM viewer to the browser.

Any of the features or attributes of the above the above describedembodiments and variations can be used in combination with any of theother features and attributes of the above described embodiments andvariations as desired.

The software of the image access system 10 of the present disclosure maybe graphically displayed in any number of suitable manners, includingbut not limited to the exemplary graphic user interfaces (GUIs) setforth in FIGS. 10-20 , with respectively (by way of example only)represent: FIG. 10 —GUI representation illustrating the feature ofattaching non-DICOM data to an existing study; FIG. 11 —GUIrepresentation illustrating the feature of DICOM and viewer downloadedto the browser; FIG. 12 —GUI representation illustrating the feature tosend multiple images to multiple emails; FIG. 13 —GUI representationillustrating the feature of requesting images from a non-registereduser; FIG. 14 —GUI representation illustrating the feature to send astudy to an email; FIG. 15 —GUI representation illustrating the abilityto send to the solution by utilizing an email as the AE Title; FIG. 16—GUI representation illustrating the feature of dynamic notifications toemails; FIG. 17 —GUI representation illustrating the log file ofincoming studies and how is communicates with third party providerAmazon; FIG. 18 —GUI representation illustrating the feature to uploadDICOM images by the user; FIG. 19 —GUI representation illustrating thefeature of multiple incoming AE Titles for each user; and FIG. 20 —GUIrepresentation illustrating the menu and work list of studies.

FIG. 21 is a block diagram of computing devices 7500, 7550 that may beused to implement the systems and methods described in this document, aseither a client or as a server or plurality of servers. Computing device7500 is intended to represent various forms of digital computers, suchas laptops, desktops, workstations, personal digital assistants,servers, blade servers, mainframes, and other appropriate computers.Computing device 7550 is intended to represent various forms of mobiledevices, such as personal digital assistants, cellular telephones,smartphones, and other similar computing devices. In this example,computing device 7550 may represent electronic device 17, whilecomputing device 7500 may represent computing systems that serve as the“cloud” referenced in this disclosure. The components shown here, theirconnections and relationships, and their functions, are meant to beexamples only, and are not meant to limit implementations describedand/or claimed in this document.

Computing device 7500 includes a processor 7502, memory 7504, a storagedevice 7506, a high-speed interface 7508 connecting to memory 7504 andhigh-speed expansion ports 7510, and a low speed interface 7512connecting to low speed bus 7514 and storage device 7506. Each of thecomponents 7502, 7504, 7506, 7508, 7510, and 7512, are interconnectedusing various busses, and may be mounted on a common motherboard or inother manners as appropriate. The processor 7502 can processinstructions for execution within the computing device 7500, includinginstructions stored in the memory 7504 or on the storage device 7506 todisplay graphical information for a GUI on an external input/outputdevice, such as display 7516 coupled to high-speed interface 7508. Inother implementations, multiple processors and/or multiple buses may beused, as appropriate, along with multiple memories and types of memory.Also, multiple computing devices 7500 may be connected, with each deviceproviding portions of the necessary operations (e.g., as a server bank,a group of blade servers, or a multi-processor system).

The memory 7504 stores information within the computing device 7500. Inone implementation, the memory 7504 is a volatile memory unit or units.In another implementation, the memory 7504 is a non-volatile memory unitor units. The memory 7504 may also be another form of computer-readablemedium, such as a magnetic or optical disk.

The storage device 7506 is capable of providing mass storage for thecomputing device 7500. In one implementation, the storage device 7506may be or contain a computer-readable medium, such as a floppy diskdevice, a hard disk device, an optical disk device, or a tape device, aflash memory or other similar solid state memory device, or an array ofdevices, including devices in a storage area network or otherconfigurations. A computer program product can be tangibly embodied inan information carrier. The computer program product may also containinstructions that, when executed, perform one or more methods, such asthose described above. The information carrier is a computer- ormachine-readable medium, such as the memory 7504, the storage device7506, or memory on processor 7502.

The high-speed controller 7508 manages bandwidth-intensive operationsfor the computing device 7500, while the low speed controller 7512manages lower bandwidth-intensive operations. Such allocation offunctions is by way of example only. In one implementation, thehigh-speed controller 7508 is coupled to memory 7504, display 7516(e.g., through a graphics processor or accelerator), and to high-speedexpansion ports 7510, which may accept various expansion cards (notshown). In the implementation, low-speed controller 7512 is coupled tostorage device 7506 and low-speed expansion port 7514. The low-speedexpansion port, which may include various communication ports (e.g.,USB, Bluetooth, Ethernet, wireless Ethernet) may be coupled to one ormore input/output devices, such as a keyboard, a pointing device, ascanner, or a networking device such as a switch or router, e.g.,through a network adapter.

The computing device 7500 may be implemented in a number of differentforms, as shown in the figure. For example, it may be implemented as astandard server 7520, or multiple times in a group of such servers. Itmay also be implemented as part of a rack server system 7524. Inaddition, it may be implemented in a personal computer such as a laptopcomputer 7522. Alternatively, components from computing device 7500 maybe combined with other components in a mobile device (not shown), suchas device 7550. Each of such devices may contain one or more ofcomputing device 7500, 7550, and an entire system may be made up ofmultiple computing devices 7500, 7550 communicating with each other.

Computing device 7550 includes a processor 7552, memory 7564, aninput/output device such as a display 7554, a communication interface7566, and a transceiver 7568, among other components. The device 7550may also be provided with a storage device, such as a microdrive orother device, to provide additional storage. Each of the components7550, 7552, 7564, 7554, 7566, and 7568, are interconnected using variousbuses, and several of the components may be mounted on a commonmotherboard or in other manners as appropriate.

The processor 7552 can execute instructions within the computing device7550, including instructions stored in the memory 7564. The processormay be implemented as a chipset of chips that include separate andmultiple analog and digital processors. Additionally, the processor maybe implemented using any of a number of architectures. For example, theprocessor 410 may be a CISC (Complex Instruction Set Computers)processor, a RISC (Reduced Instruction Set Computer) processor, or aMISC (Minimal Instruction Set Computer) processor. The processor mayprovide, for example, for coordination of the other components of thedevice 7550, such as control of user interfaces, applications run bydevice 7550, and wireless communication by device 7550.

Processor 7552 may communicate with a user through control interface7558 and display interface 7556 coupled to a display 7554. The display7554 may be, for example, a TFT (Thin-Film-Transistor Liquid CrystalDisplay) display or an OLED (Organic Light Emitting Diode) display, orother appropriate display technology. The display interface 7556 maycomprise appropriate circuitry for driving the display 7554 to presentgraphical and other information to a user. The control interface 7558may receive commands from a user and convert them for submission to theprocessor 7552. In addition, an external interface 7562 may be providedin communication with processor 7552, so as to enable near areacommunication of device 7550 with other devices. External interface 7562may provide, for example, for wired communication in someimplementations, or for wireless communication in other implementations,and multiple interfaces may also be used.

The memory 7564 stores information within the computing device 7550. Thememory 7564 can be implemented as one or more of a computer-readablemedium or media, a volatile memory unit or units, or a non-volatilememory unit or units. Expansion memory 7574 may also be provided andconnected to device 7550 through expansion interface 7572, which mayinclude, for example, a SIMM (Single In Line Memory Module) cardinterface. Such expansion memory 7574 may provide extra storage spacefor device 7550, or may also store applications or other information fordevice 7550. Specifically, expansion memory 7574 may includeinstructions to carry out or supplement the processes described above,and may include secure information also. Thus, for example, expansionmemory 7574 may be provided as a security module for device 7550, andmay be programmed with instructions that permit secure use of device7550. In addition, secure applications may be provided via the SIMMcards, along with additional information, such as placing identifyinginformation on the SIMM card in a non-hackable manner.

The memory may include, for example, flash memory and/or NVRAM memory,as discussed below. In one implementation, a computer program product istangibly embodied in an information carrier. The computer programproduct contains instructions that, when executed, cause performance ofone or more methods, such as those described above. The informationcarrier is a computer- or machine-readable medium, such as the memory7564, expansion memory 7574, or memory on processor 7552 that may bereceived, for example, over transceiver 7568 or external interface 7562.

Device 7550 may communicate wirelessly through communication interface7566, which may include digital signal processing circuitry wherenecessary. Communication interface 7566 may provide for communicationsunder various modes or protocols, such as GSM voice calls, SMS, EMS, orMMS messaging, CDMA, TDMA, PDC, WCDMA, CDMA2000, or GPRS, among others.Such communication may occur, for example, through radio-frequencytransceiver 7568. In addition, short-range communication may occur, suchas using a Bluetooth, WiFi, or other such transceiver (not shown). Inaddition, GPS (Global Positioning System) receiver module 7570 mayprovide additional navigation- and location-related wireless data todevice 7550, which may be used as appropriate by applications running ondevice 7550.

Device 7550 may also communicate audibly using audio codec 7560, whichmay receive spoken information from a user and convert it to usabledigital information. Audio codec 7560 may likewise generate audiblesound for a user, such as through a speaker, e.g., in a handset ofdevice 7550. Such sound may include sound from voice telephone calls,may include recorded sound (e.g., voice messages, music files, etc.) andmay also include sound generated by applications operating on device7550.

The computing device 7550 may be implemented in a number of differentforms, some of which are shown in the figure. For example, it may beimplemented as a cellular telephone 7580. It may also be implemented aspart of a smartphone 7582, personal digital assistant, or other similarmobile device.

Additionally computing device 7500 or 7550 can include Universal SerialBus (USB) flash drives. The USB flash drives may store operating systemsand other applications. The USB flash drives can include input/outputcomponents, such as a wireless transmitter or USB connector that may beinserted into a USB port of another computing device.

Various implementations of the systems and techniques described here canbe realized in digital electronic circuitry, integrated circuitry,specially designed ASICs (application specific integrated circuits),computer hardware, firmware, software, and/or combinations thereof.These various implementations can include implementation in one or morecomputer programs that are executable and/or interpretable on aprogrammable system including at least one programmable processor, whichmay be special or general purpose, coupled to receive data andinstructions from, and to transmit data and instructions to, a storagesystem, at least one input device, and at least one output device.

These computer programs (also known as programs, software, softwareapplications or code) include machine instructions for a programmableprocessor, and can be implemented in a high-level procedural and/orobject-oriented programming language, and/or in assembly/machinelanguage. As used herein, the terms “machine-readable medium” and“computer-readable medium” refer to any computer program product,apparatus and/or device (e.g., magnetic discs, optical disks, memory,Programmable Logic Devices (PLDs)) used to provide machine instructionsand/or data to a programmable processor.

To provide for interaction with a user, the systems and techniquesdescribed here can be implemented on a computer having a display device(e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor)for displaying information to the user and a keyboard and a pointingdevice (e.g., a mouse or a trackball) by which the user can provideinput to the computer. Other kinds of devices can be used to provide forinteraction with a user as well; for example, feedback provided to theuser can be any form of sensory feedback (e.g., visual feedback,auditory feedback, or tactile feedback); and input from the user can bereceived in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in acomputing system that includes a back end component (e.g., as a dataserver), or that includes a middleware component (e.g., an applicationserver), or that includes a front end component (e.g., a client computerhaving a graphical user interface or a Web browser through which a usercan interact with an implementation of the systems and techniquesdescribed here), or any combination of such back end, middleware, orfront end components. The components of the system can be interconnectedby any form or medium of digital data communication (e.g., acommunication network). Examples of communication networks include alocal area network (“LAN”), a wide area network (“WAN”), peer-to-peernetworks (having ad-hoc or static members), grid computinginfrastructures, and the Internet.

The computing system can include clients and servers. A client andserver are generally remote from each other and typically interactthrough a communication network. The relationship of client and serverarises by virtue of computer programs running on the respectivecomputers and having a client-server relationship to each other.

While the inventive features described herein have been described interms of a preferred embodiment for achieving the objectives, it will beappreciated by those skilled in the art that variations may beaccomplished in view of these teachings without deviating from thespirit or scope of the disclosure. Furthermore, the various features ofthe disclosure have been described using several example embodiments. Itshould be understood that any feature or combination of featuresdescribed with regard to a particular example embodiment may be appliedto any other example embodiment in any combination without reservation.

Systems, methods, and computer program products are provided. In thedetailed description herein, references to “various embodiments,” “oneembodiment,” “an embodiment,” “an example embodiment,” etc., indicatethat the embodiment described may include a particular feature,structure, or characteristic, but every embodiment may not necessarilyinclude the particular feature, structure, or characteristic. Moreover,such phrases are not necessarily referring to the same embodiment.Further, when a particular feature, structure, or characteristic isdescribed in connection with an embodiment, it is submitted that it iswithin the knowledge of one skilled in the art to affect such feature,structure, or characteristic in connection with other embodimentswhether or not explicitly described. After reading the description, itwill be apparent to one skilled in the relevant art(s) how to implementthe disclosure in alternative embodiments.

As used herein, “satisfy,” “meet,” “match,” “associated with”, orsimilar phrases may include an identical match, a partial match, meetingcertain criteria, matching a subset of data, a correlation, satisfyingcertain criteria, a correspondence, an association, an algorithmicrelationship, and/or the like. Similarly, as used herein, “authenticate”or similar terms may include an exact authentication, a partialauthentication, authenticating a subset of data, a correspondence,satisfying certain criteria, an association, an algorithmicrelationship, and/or the like.

Terms and phrases similar to “associate” and/or “associating” mayinclude tagging, flagging, correlating, using a look-up table or anyother method or system for indicating or creating a relationship betweenelements, such as, for example, (i) a transaction account and (ii) anitem (e.g., offer, reward, discount) and/or digital channel. Moreover,the associating may occur at any point, in response to any suitableaction, event, or period of time. The associating may occur atpre-determined intervals, periodic, randomly, once, more than once, orin response to a suitable request or action. Any of the information maybe distributed and/or accessed via a software enabled link, wherein thelink may be sent via an email, text, post, social network input, and/orany other method known in the art.

As used herein, “transmit” may include sending electronic data from onesystem component to another over a network connection. Additionally, asused herein, “data” may include encompassing information such ascommands, queries, files, data for storage, and the like in digital orany other form.

As used herein, the term “network” includes any cloud, cloud computingsystem, or electronic communications system or method which incorporateshardware and/or software components. Communication among the parties maybe accomplished through any suitable communication channels, such as,for example, a telephone network, an extranet, an intranet, internet,point of interaction device (point of sale device, personal digitalassistant (e.g., an IPHONE® device, a BLACKBERRY® device), cellularphone, kiosk, etc.), online communications, satellite communications,off-line communications, wireless communications, transpondercommunications, local area network (LAN), wide area network (WAN),virtual private network (VPN), networked or linked devices, keyboard,mouse, and/or any suitable communication or data input modality.Moreover, although the system is frequently described herein as beingimplemented with TCP/IP communications protocols, the system may also beimplemented using IPX, APPLETALK® program, IP-6, NetBIOS, OSI, anytunneling protocol (e.g. IPsec, SSH, etc.), or any number of existing orfuture protocols. If the network is in the nature of a public network,such as the internet, it may be advantageous to presume the network tobe insecure and open to eavesdroppers. Specific information related tothe protocols, standards, and application software utilized inconnection with the internet is generally known to those skilled in theart and, as such, need not be detailed herein. See, for example, DILIPNAIK, INTERNET STANDARDS AND PROTOCOLS (1998); JAVA® 2 COMPLETE, variousauthors, (Sybex 1999); DEBORAH RAY AND ERIC RAY, MASTERING HTML 4.0(1997); and LOSHIN, TCP/IP CLEARLY EXPLAINED (1997) and DAVID GOURLEYAND BRIAN TOTTY, HTTP, THE DEFINITIVE GUIDE (2002), the contents ofwhich are hereby incorporated by reference.

“Cloud” or “Cloud computing” includes a model for enabling convenient,on-demand network access to a shared pool of configurable computingresources (e.g., networks, servers, storage, applications, and services)that can be rapidly provisioned and released with minimal managementeffort or service provider interaction. Cloud computing may includelocation-independent computing, whereby shared servers provideresources, software, and data to computers and other devices on demand.For more information regarding cloud computing, see the NIST's (NationalInstitute of Standards and Technology) definition of cloud computing atwww.csrc.nist.gov/publications/nistpubs/800-145/SP800-145 (last visitedJune 2012), which is hereby incorporated by reference in its entirety.

Computer programs (also referred to as computer control logic) arestored in main memory and/or secondary memory. Computer programs mayalso be received via communications interface. Such computer programs,when executed, enable the computer system to perform the features asdiscussed herein. In particular, the computer programs, when executed,enable the processor to perform the features of various embodiments.Accordingly, such computer programs represent controllers of thecomputer system.

These computer program instructions may be loaded onto a general purposecomputer, special purpose computer, or other programmable dataprocessing apparatus to produce a machine, such that the instructionsthat execute on the computer or other programmable data processingapparatus create means for implementing the functions specified in theflowchart block or blocks. These computer program instructions may alsobe stored in a computer-readable memory that can direct a computer orother programmable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instruction meanswhich implement the function specified in the flowchart block or blocks.The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer-implemented process such that theinstructions which execute on the computer or other programmableapparatus provide steps for implementing the functions specified in theflowchart block or blocks.

In various embodiments, software may be stored in a computer programproduct and loaded into a computer system using removable storage drive,hard disk drive, or communications interface. The control logic(software), when executed by the processor, causes the processor toperform the functions of various embodiments as described herein. Invarious embodiments, hardware components may take the form ofapplication specific integrated circuits (ASICs). Implementation of thehardware state machine so as to perform the functions described hereinwill be apparent to persons skilled in the relevant art(s).

As will be appreciated by one of ordinary skill in the art, the systemmay be embodied as a customization of an existing system, an add-onproduct, a processing apparatus executing upgraded software, astand-alone system, a distributed system, a method, a data processingsystem, a device for data processing, and/or a computer program product.Accordingly, any portion of the system or a module may take the form ofa processing apparatus executing code, an internet based embodiment, anentirely hardware embodiment, or an embodiment combining aspects of theinternet, software, and hardware. Furthermore, the system may take theform of a computer program product on a computer-readable storage mediumhaving computer-readable program code means embodied in the storagemedium. Any suitable computer-readable storage medium may be utilized,including hard disks, CD-ROM, BLU-RAY DISC®, optical storage devices,magnetic storage devices, and/or the like.

In various embodiments, components, modules, and/or engines of system100 may be implemented as micro-applications or micro-apps. Micro-appsare typically deployed in the context of a mobile operating system,including for example, a WINDOWS® mobile operating system, an ANDROID®operating system, an APPLE® iOS operating system, a BLACKBERRY®company's operating system, and the like. The micro-app may beconfigured to leverage the resources of the larger operating system andassociated hardware via a set of predetermined rules which govern theoperations of various operating systems and hardware resources. Forexample, where a micro-app desires to communicate with a device ornetwork other than the mobile device or mobile operating system, themicro-app may leverage the communication protocol of the operatingsystem and associated device hardware under the predetermined rules ofthe mobile operating system. Moreover, where the micro-app desires aninput from a user, the micro-app may be configured to request a responsefrom the operating system which monitors various hardware components andthen communicates a detected input from the hardware to the micro-app.

The system and method may be described herein in terms of functionalblock components, screen shots, optional selections, and variousprocessing steps. It should be appreciated that such functional blocksmay be realized by any number of hardware and/or software componentsconfigured to perform the specified functions. For example, the systemmay employ various integrated circuit components, e.g., memory elements,processing elements, logic elements, look-up tables, and the like, whichmay carry out a variety of functions under the control of one or moremicroprocessors or other control devices. Similarly, the softwareelements of the system may be implemented with any programming orscripting language such as C, C++, C#, JAVA®, JAVASCRIPT®, JAVASCRIPT®Object Notation (JSON), VBScript, Macromedia COLD FUSION, COBOL,MICROSOFT® company's Active Server Pages, assembly, PERL®, PHP, awk,PYTHON®, Visual Basic, SQL Stored Procedures, PL/SQL, any UNIX® shellscript, and extensible markup language (XML) with the various algorithmsbeing implemented with any combination of data structures, objects,processes, routines or other programming elements. Further, it should benoted that the system may employ any number of conventional techniquesfor data transmission, signaling, data processing, network control, andthe like. Still further, the system could be used to detect or preventsecurity issues with a client-side scripting language, such asJAVASCRIPT®, VBScript, or the like. For a basic introduction ofcryptography and network security, see any of the following references:(1) “Applied Cryptography: Protocols, Algorithms, And Source Code In C,”by Bruce Schneier, published by John Wiley & Sons (second edition,1995); (2) “JAVA® Cryptography” by Jonathan Knudson, published byO'Reilly & Associates (1998); (3) “Cryptography & Network Security:Principles & Practice” by William Stallings, published by Prentice Hall;all of which are hereby incorporated by reference.

Accordingly, functional blocks of the block diagrams and flowchartillustrations support combinations of means for performing the specifiedfunctions, combinations of steps for performing the specified functions,and program instruction means for performing the specified functions. Itwill also be understood that each functional block of the block diagramsand flowchart illustrations, and combinations of functional blocks inthe block diagrams and flowchart illustrations, can be implemented byeither special purpose hardware-based computer systems which perform thespecified functions or steps, or suitable combinations of specialpurpose hardware and computer instructions. Further, illustrations ofthe process flows and the descriptions thereof may make reference touser WINDOWS® applications, webpages, websites, web forms, prompts, etc.Practitioners will appreciate that the illustrated steps describedherein may comprise in any number of configurations including the use ofWINDOWS® applications, webpages, web forms, popup WINDOWS® applications,prompts, and the like. It should be further appreciated that themultiple steps as illustrated and described may be combined into singlewebpages and/or WINDOWS® applications but have been expanded for thesake of simplicity. In other cases, steps illustrated and described assingle process steps may be separated into multiple webpages and/orWINDOWS® applications but have been combined for simplicity.

In various embodiments, the software elements of the system may also beimplemented using NODE.JS® components. NODE.JS® programs may implementseveral modules to handle various core functionalities. For example, apackage management module, such as NPM®, may be implemented as an opensource library to aid in organizing the installation and management ofthird-party NODE.JS® programs. NODE.JS® programs may also implement aprocess manager, such as, for example, Parallel Multithreaded Machine(“PM2”); a resource and performance monitoring tool, such as, forexample, Node Application Metrics (“appmetrics”); a library module forbuilding user interfaces, and/or any other suitable and/or desiredmodule.

Middleware may include any hardware and/or software suitably configuredto facilitate communications and/or process transactions betweendisparate computing systems. Middleware components are commerciallyavailable and known in the art. Middleware may be implemented throughcommercially available hardware and/or software, through custom hardwareand/or software components, or through a combination thereof. Middlewaremay reside in a variety of configurations and may exist as a standalonesystem or may be a software component residing on the internet server.Middleware may be configured to process transactions between the variouscomponents of an application server and any number of internal orexternal systems for any of the purposes disclosed herein. WEB SPHERE®MQ™ (formerly MQSeries) by IBM®, Inc. (Armonk, N.Y.) is an example of acommercially available middleware product. An Enterprise Service Bus(“ESB”) application is another example of middleware.

The computers discussed herein may provide a suitable website or otherinternet-based graphical user interface which is accessible by users. Inone embodiment, MICROSOFT® company's Internet Information Services(IIS), Transaction Server (MTS) service, and an SQL SERVER® database,are used in conjunction with MICROSOFT® operating systems, WINDOWS NT®web server software, SQL SERVER® database, and MICROSOFT® CommerceServer. Additionally, components such as ACCESS® software, SQL SERVER®database, ORACLE® software, SYBASE® software, INFORMIX® software, MYSQL®software, INTERBASE® software, etc., may be used to provide an ActiveData Object (ADO) compliant database management system. In oneembodiment, the APACHE® web server is used in conjunction with a LINUX®operating system, a MYSQL® database, and PERL®, PHP, Ruby, and/orPYTHON® programming languages.

For the sake of brevity, conventional data networking, applicationdevelopment, and other functional aspects of the systems (and componentsof the individual operating components of the systems) may not bedescribed in detail herein. Furthermore, the connecting lines shown inthe various figures contained herein are intended to represent exemplaryfunctional relationships and/or physical couplings between the variouselements. It should be noted that many alternative or additionalfunctional relationships or physical connections may be present in apractical system.

In various embodiments, the methods described herein are implementedusing the various particular machines described herein. The methodsdescribed herein may be implemented using the below particular machines,and those hereinafter developed, in any suitable combination, as wouldbe appreciated immediately by one skilled in the art. Further, as isunambiguous from this disclosure, the methods described herein mayresult in various transformations of certain articles.

In various embodiments, the system and various components may integratewith one or more smart digital assistant technologies. For example,exemplary smart digital assistant technologies may include the ALEXA®system developed by the AMAZON® company, the GOOGLE HOME® systemdeveloped by Alphabet, Inc., the HOMEPOD® system of the APPLE® company,and/or similar digital assistant technologies. The ALEXA® system, GOOGLEHOME® system, and HOMEPOD® system, may each provide cloud-based voiceactivation services that can assist with tasks, entertainment, generalinformation, and more. All the ALEXA® devices, such as the AMAZON ECHO®,AMAZON ECHO DOT®, AMAZON TAP®, and AMAZON FIRE® TV, have access to theALEXA® system. The ALEXA® system, GOOGLE HOME® system, and HOMEPOD®system may receive voice commands via its voice activation technology,activate other functions, control smart devices, and/or gatherinformation. For example, the smart digital assistant technologies maybe used to interact with music, emails, texts, phone calls, questionanswering, home improvement information, smart homecommunication/activation, games, shopping, making to-do lists, settingalarms, streaming podcasts, playing audiobooks, and providing weather,traffic, and other real time information, such as news. The ALEXA®,GOOGLE HOME®, and HOMEPOD® systems may also allow the user to accessinformation about eligible transaction accounts linked to an onlineaccount across all digital assistant-enabled devices.

The various system components discussed herein may include one or moreof the following: a host server or other computing systems including aprocessor for processing digital data; a memory coupled to the processorfor storing digital data; an input digitizer coupled to the processorfor inputting digital data; an application program stored in the memoryand accessible by the processor for directing processing of digital databy the processor; a display device coupled to the processor and memoryfor displaying information derived from digital data processed by theprocessor; and a plurality of databases. Various databases used hereinmay include: client data; merchant data; financial institution data;and/or like data useful in the operation of the system. As those skilledin the art will appreciate, user computer may include an operatingsystem (e.g., WINDOWS®, UNIX®, LINUX®, SOLARIS®, MACOS®, etc.) as wellas various conventional support software and drivers typicallyassociated with computers.

The present system or any part(s) or function(s) thereof may beimplemented using hardware, software, or a combination thereof and maybe implemented in one or more computer systems or other processingsystems. However, the manipulations performed by embodiments were oftenreferred to in terms, such as matching or selecting, which are commonlyassociated with mental operations performed by a human operator. No suchcapability of a human operator is necessary, or desirable in most cases,in any of the operations described herein. Rather, the operations may bemachine operations or any of the operations may be conducted or enhancedby artificial intelligence (AI) or machine learning. Artificialintelligence may refer generally to the study of agents (e.g., machines,computer-based systems, etc.) that perceive the world around them, formplans, and make decisions to achieve their goals. Foundations of AIinclude mathematics, logic, philosophy, probability, linguistics,neuroscience, and decision theory. Many fields fall under the umbrellaof AI, such as computer vision, robotics, machine learning, and naturallanguage processing. Useful machines for performing the variousembodiments include general purpose digital computers or similardevices.

In various embodiments, the server may include application servers (e.g.WEBSPHERE®, WEBLOGIC®, JBOSS®, POSTGRES PLUS ADVANCED SERVER®, etc.). Invarious embodiments, the server may include web servers (e.g. Apache,IIS, GOOGLE® Web Server, SUN JAVA® System Web Server, JAVA® VirtualMachine running on LINUX® or WINDOWS® operating systems).

A web client includes any device or software which communicates via anynetwork, such as, for example any device or software discussed herein.The web client may include internet browsing software installed within acomputing unit or system to conduct online transactions and/orcommunications. These computing units or systems may take the form of acomputer or set of computers, although other types of computing units orsystems may be used, including personal computers, laptops, notebooks,tablets, smart phones, cellular phones, personal digital assistants,servers, pooled servers, mainframe computers, distributed computingclusters, kiosks, terminals, point of sale (POS) devices or terminals,televisions, or any other device capable of receiving data over anetwork. The web client may include an operating system (e.g., WINDOWS®,WINDOWS MOBILE® operating systems, UNIX® operating system, LINUX®operating systems, APPLE® OS® operating systems, etc.) as well asvarious conventional support software and drivers typically associatedwith computers. The web-client may also run MICROSOFT® INTERNETEXPLORER® software, MOZILLA® FIREFOX® software, GOOGLE® CHROME®software, APPLE® SAFARI® software, or any other of the myriad softwarepackages available for browsing the internet.

As those skilled in the art will appreciate, the web client may or maynot be in direct contact with the server (e.g., application server, webserver, etc., as discussed herein). For example, the web client mayaccess the services of the server through another server and/or hardwarecomponent, which may have a direct or indirect connection to an internetserver. For example, the web client may communicate with the server viaa load balancer. In various embodiments, web client access is through anetwork or the internet through a commercially-available web-browsersoftware package. In that regard, the web client may be in a home orbusiness environment with access to the network or the internet. The webclient may implement security protocols such as Secure Sockets Layer(SSL) and Transport Layer Security (TLS). A web client may implementseveral application layer protocols including HTTP, HTTPS, FTP, andSFTP.

The various system components may be independently, separately, orcollectively suitably coupled to the network via data links whichincludes, for example, a connection to an Internet Service Provider(ISP) over the local loop as is typically used in connection withstandard modem communication, cable modem, DISH NETWORK®, ISDN, DigitalSubscriber Line (DSL), or various wireless communication methods, see,e.g., GILBERT HELD, UNDERSTANDING DATA COMMUNICATIONS (1996), which ishereby incorporated by reference. It is noted that the network may beimplemented as other types of networks, such as an interactivetelevision (ITV) network. Moreover, the system contemplates the use,sale, or distribution of any goods, services, or information over anynetwork having similar functionality described herein.

The system contemplates uses in association with web services, utilitycomputing, pervasive and individualized computing, security and identitysolutions, autonomic computing, cloud computing, commodity computing,mobility and wireless solutions, open source, biometrics, gridcomputing, and/or mesh computing.

Any of the communications, inputs, storage, databases or displaysdiscussed herein may be facilitated through a website having web pages.The term “web page” as it is used herein is not meant to limit the typeof documents and applications that might be used to interact with theuser. For example, a typical website might include, in addition tostandard HTML documents, various forms, JAVA® applets, JAVASCRIPT®programs, active server pages (ASP), common gateway interface scripts(CGI), extensible markup language (XML), dynamic HTML, cascading stylesheets (CSS), AJAX (Asynchronous JAVASCRIPT And XML) programs, helperapplications, plug-ins, and the like. A server may include a web servicethat receives a request from a web server, the request including a URLand an IP address (192.168.1.1). The web server retrieves theappropriate web pages and sends the data or applications for the webpages to the IP address. Web services are applications that are capableof interacting with other applications over a communications means, suchas the internet. Web services are typically based on standards orprotocols such as XML, SOAP, AJAX, WSDL and UDDI. Web services methodsare well known in the art, and are covered in many standard texts. See,e.g., ALEX NGHIEM, IT WEB SERVICES: A ROADMAP FOR THE ENTERPRISE (2003),hereby incorporated by reference. For example, representational statetransfer (REST), or RESTful, web services may provide one way ofenabling interoperability between applications.

The computing unit of the web client may be further equipped with aninternet browser connected to the internet or an intranet using standarddial-up, cable, DSL, or any other internet protocol known in the art.Transactions originating at a web client may pass through a firewall inorder to prevent unauthorized access from users of other networks.Further, additional firewalls may be deployed between the varyingcomponents of CMS to further enhance security.

Encryption may be performed by way of any of the techniques nowavailable in the art or which may become available—e.g., Twofish, RSA,El Gamal, Schorr signature, DSA, PGP, PKI, GPG (GnuPG), HPEFormat-Preserving Encryption (FPE), Voltage, Triple DES, Blowfish, AES,MD5, HMAC, IDEA, RC6, and symmetric and asymmetric cryptosystems. Thesystems and methods may also incorporate SHA series cryptographicmethods, elliptic curve cryptography (e.g., ECC, ECDH, ECDSA, etc.),and/or other post-quantum cryptography algorithms under development.

The firewall may include any hardware and/or software suitablyconfigured to protect CMS components and/or enterprise computingresources from users of other networks. Further, a firewall may beconfigured to limit or restrict access to various systems and componentsbehind the firewall for web clients connecting through a web server.Firewall may reside in varying configurations including StatefulInspection, Proxy based, access control lists, and Packet Filteringamong others. Firewall may be integrated within a web server or anyother CMS components or may further reside as a separate entity. Afirewall may implement network address translation (“NAT”) and/ornetwork address port translation (“NAPT”). A firewall may accommodatevarious tunneling protocols to facilitate secure communications, such asthose used in virtual private networking. A firewall may implement ademilitarized zone (“DMZ”) to facilitate communications with a publicnetwork such as the internet. A firewall may be integrated as softwarewithin an internet server, any other application server components ormay reside within another computing device or may take the form of astandalone hardware component.

Any databases discussed herein may include relational, hierarchical,graphical, blockchain, object-oriented structure, and/or any otherdatabase configurations. Any database may also include a flat filestructure wherein data may be stored in a single file in the form ofrows and columns, with no structure for indexing and no structuralrelationships between records. For example, a flat file structure mayinclude a delimited text file, a CSV (comma-separated values) file,and/or any other suitable flat file structure. Common database productsthat may be used to implement the databases include DB2® by IBM®(Armonk, N.Y.), various database products available from ORACLE®Corporation (Redwood Shores, Calif.), MICROSOFT ACCESS® or MICROSOFT SQLSERVER® by MICROSOFT® Corporation (Redmond, Wash.), MYSQL® by MySQL AB(Uppsala, Sweden), MONGODB®, Redis, APACHE CASSANDRA®, HBASE® byAPACHE®, MapR-DB by the MAPR® corporation, or any other suitabledatabase product. Moreover, any database may be organized in anysuitable manner, for example, as data tables or lookup tables. Eachrecord may be a single file, a series of files, a linked series of datafields, or any other data structure.

As used herein, big data may refer to partially or fully structured,semi-structured, or unstructured data sets including millions of rowsand hundreds of thousands of columns. A big data set may be compiled,for example, from a history of purchase transactions over time, from webregistrations, from social media, from records of charge (ROC), fromsummaries of charges (SOC), from internal data, or from other suitablesources. Big data sets may be compiled without descriptive metadata suchas column types, counts, percentiles, or other interpretive-aid datapoints.

Association of certain data may be accomplished through any desired dataassociation technique such as those known or practiced in the art. Forexample, the association may be accomplished either manually orautomatically. Automatic association techniques may include, forexample, a database search, a database merge, GREP, AGREP, SQL, using akey field in the tables to speed searches, sequential searches throughall the tables and files, sorting records in the file according to aknown order to simplify lookup, and/or the like. The association stepmay be accomplished by a database merge function, for example, using a“key field” in pre-selected databases or data sectors. Various databasetuning steps are contemplated to optimize database performance. Forexample, frequently used files such as indexes may be placed on separatefile systems to reduce In/Out (“I/O”) bottlenecks.

More particularly, a “key field” partitions the database according tothe high-level class of objects defined by the key field. For example,certain types of data may be designated as a key field in a plurality ofrelated data tables and the data tables may then be linked on the basisof the type of data in the key field. The data corresponding to the keyfield in each of the linked data tables is preferably the same or of thesame type. However, data tables having similar, though not identical,data in the key fields may also be linked by using AGREP, for example.In accordance with one embodiment, any suitable data storage techniquemay be utilized to store data without a standard format. Data sets maybe stored using any suitable technique, including, for example, storingindividual files using an ISO/IEC 7816-4 file structure; implementing adomain whereby a dedicated file is selected that exposes one or moreelementary files containing one or more data sets; using data setsstored in individual files using a hierarchical filing system; data setsstored as records in a single file (including compression, SQLaccessible, hashed via one or more keys, numeric, alphabetical by firsttuple, etc.); data stored as Binary Large Object (BLOB); data stored asungrouped data elements encoded using ISO/IEC 7816-6 data elements; datastored as ungrouped data elements encoded using ISO/IEC Abstract SyntaxNotation (ASN.1) as in ISO/IEC 8824 and 8825; other proprietarytechniques that may include fractal compression methods, imagecompression methods, etc.

In various embodiments, the ability to store a wide variety ofinformation in different formats is facilitated by storing theinformation as a BLOB. Thus, any binary information can be stored in astorage space associated with a data set. As discussed above, the binaryinformation may be stored in association with the system or external tobut affiliated with system. The BLOB method may store data sets asungrouped data elements formatted as a block of binary via a fixedmemory offset using either fixed storage allocation, circular queuetechniques, or best practices with respect to memory management (e.g.,paged memory, least recently used, etc.). By using BLOB methods, theability to store various data sets that have different formatsfacilitates the storage of data, in the database or associated with thesystem, by multiple and unrelated owners of the data sets. For example,a first data set which may be stored may be provided by a first party, asecond data set which may be stored may be provided by an unrelatedsecond party, and yet a third data set which may be stored, may beprovided by an third party unrelated to the first and second party. Eachof these three exemplary data sets may contain different informationthat is stored using different data storage formats and/or techniques.Further, each data set may contain subsets of data that also may bedistinct from other subsets.

As stated above, in various embodiments, the data can be stored withoutregard to a common format. However, the data set (e.g., BLOB) may beannotated in a standard manner when provided for manipulating the datain the database or system. The annotation may comprise a short header,trailer, or other appropriate indicator related to each data set that isconfigured to convey information useful in managing the various datasets. For example, the annotation may be called a “condition header,”“header,” “trailer,” or “status,” herein, and may comprise an indicationof the status of the data set or may include an identifier correlated toa specific issuer or owner of the data. In one example, the first threebytes of each data set BLOB may be configured or configurable toindicate the status of that particular data set; e.g., LOADED,INITIALIZED, READY, BLOCKED, REMOVABLE, or DELETED. Subsequent bytes ofdata may be used to indicate for example, the identity of the issuer,user, transaction/membership account identifier or the like. Each ofthese condition annotations are further discussed herein.

The data set annotation may also be used for other types of statusinformation as well as various other purposes. For example, the data setannotation may include security information establishing access levels.The access levels may, for example, be configured to permit only certainindividuals, levels of employees, companies, or other entities to accessdata sets, or to permit access to specific data sets based on thetransaction, merchant, issuer, user, or the like. Furthermore, thesecurity information may restrict/permit only certain actions such asaccessing, modifying, and/or deleting data sets. In one example, thedata set annotation indicates that only the data set owner or the userare permitted to delete a data set, various identified users may bepermitted to access the data set for reading, and others are altogetherexcluded from accessing the data set. However, other access restrictionparameters may also be used allowing various entities to access a dataset with various permission levels as appropriate.

The data, including the header or trailer, may be received by astandalone interaction device configured to add, delete, modify, oraugment the data in accordance with the header or trailer. As such, inone embodiment, the header or trailer is not stored on the transactiondevice along with the associated issuer-owned data but instead theappropriate action may be taken by providing to the user at thestandalone device, the appropriate option for the action to be taken.The system may contemplate a data storage arrangement wherein the headeror trailer, or header or trailer history, of the data is stored on thesystem, device or transaction instrument in relation to the appropriatedata.

One skilled in the art will also appreciate that, for security reasons,any databases, systems, devices, servers, or other components of thesystem may consist of any combination thereof at a single location or atmultiple locations, wherein each database or system includes any ofvarious suitable security features, such as firewalls, access codes,encryption, decryption, compression, decompression, and/or the like.

Practitioners will also appreciate that there are a number of methodsfor displaying data within a browser-based document. Data may berepresented as standard text or within a fixed list, scrollable list,drop-down list, editable text field, fixed text field, pop-up window,and the like. Likewise, there are a number of methods available formodifying data in a web page such as, for example, free text entry usinga keyboard, selection of menu items, check boxes, option boxes, and thelike.

Distributed computing cluster may be, for example, a HADOOP® softwarecluster configured to process and store big data sets with some of nodescomprising a distributed storage system and some of nodes comprising adistributed processing system. In that regard, distributed computingcluster may be configured to support a HADOOP® software distributed filesystem (HDFS) as specified by the Apache Software Foundation atwww.hadoop.apache.org/docs.

Any database discussed herein may comprise a distributed ledgermaintained by a plurality of computing devices (e.g., nodes) over apeer-to-peer network. Each computing device maintains a copy and/orpartial copy of the distributed ledger and communicates with one or moreother computing devices in the network to validate and write data to thedistributed ledger. The distributed ledger may use features andfunctionality of blockchain technology, including, for example,consensus based validation, immutability, and cryptographically chainedblocks of data. The blockchain may comprise a ledger of interconnectedblocks containing data. The blockchain may provide enhanced securitybecause each block may hold individual transactions and the results ofany blockchain executables. Each block may link to the previous blockand may include a timestamp. Blocks may be linked because each block mayinclude the hash of the prior block in the blockchain. The linked blocksform a chain, with only one successor block allowed to link to one otherpredecessor block for a single chain. Forks may be possible wheredivergent chains are established from a previously uniform blockchain,though typically only one of the divergent chains will be maintained asthe consensus chain. In various embodiments, the blockchain mayimplement smart contracts that enforce data workflows in a decentralizedmanner. The system may also include applications deployed on userdevices such as, for example, computers, tablets, smartphones, Internetof Things devices (“IoT” devices), etc. The applications may communicatewith the blockchain (e.g., directly or via a blockchain node) totransmit and retrieve data. In various embodiments, a governingorganization or consortium may control access to data stored on theblockchain. Registration with the managing organization(s) may enableparticipation in the blockchain network.

Data transfers performed through the blockchain-based system maypropagate to the connected peers within the blockchain network within aduration that may be determined by the block creation time of thespecific blockchain technology implemented. For example, on anETHEREUM®-based network, a new data entry may become available withinabout 13-20 seconds as of the writing. On a HYPERLEDGER® Fabric 1.0based platform, the duration is driven by the specific consensusalgorithm that is chosen, and may be performed within seconds. In thatrespect, propagation times in the system may be improved compared toexisting systems, and implementation costs and time to market may alsobe drastically reduced. The system also offers increased security atleast partially due to the immutable nature of data that is stored inthe blockchain, reducing the probability of tampering with various datainputs and outputs. Moreover, the system may also offer increasedsecurity of data by performing cryptographic processes on the data priorto storing the data on the blockchain. Therefore, by transmitting,storing, and accessing data using the system described herein, thesecurity of the data is improved, which decreases the risk of thecomputer or network from being compromised.

In various embodiments, the system may also reduce databasesynchronization errors by providing a common data structure, thus atleast partially improving the integrity of stored data. The system alsooffers increased reliability and fault tolerance over traditionaldatabases (e.g., relational databases, distributed databases, etc.) aseach node operates with a full copy of the stored data, thus at leastpartially reducing downtime due to localized network outages andhardware failures. The system may also increase the reliability of datatransfers in a network environment having reliable and unreliable peers,as each node broadcasts messages to all connected peers, and, as eachblock comprises a link to a previous block, a node may quickly detect amissing block and propagate a request for the missing block to the othernodes in the blockchain network.

Any communication, transmission, and/or channel discussed herein mayinclude any system or method for delivering content (e.g. data,information, metadata, etc.), and/or the content itself. The content maybe presented in any form or medium, and in various embodiments, thecontent may be delivered electronically and/or capable of beingpresented electronically. For example, a channel may comprise a website,mobile application, or device (e.g., FACEBOOK®, YOUTUBE®, PANDORA®,APPLE TV®, MICROSOFT® XBOX®, ROKU®, AMAZON FIRE®, GOOGLE CHROMECAST™,SONY® PLAYSTATION®, NINTENDO® SWITCH®, etc.) a uniform resource locator(“URL”), a document (e.g., a MICROSOFT® Word™ or EXCEL®, an ADOBE®Portable Document Format (PDF) document, etc.), an “ebook,” an“emagazine,” an application or microapplication (as described herein),an SMS or other type of text message, an email, a FACEBOOK® message, aTWITTER® tweet, multimedia messaging services (MMS), and/or other typeof communication technology. In various embodiments, a channel may behosted or provided by a data partner. In various embodiments, thedistribution channel may comprise at least one of a merchant website, asocial media website, affiliate or partner websites, an external vendor,a mobile device communication, social media network, and/or locationbased service. Distribution channels may include at least one of amerchant website, a social media site, affiliate or partner websites, anexternal vendor, and a mobile device communication. Examples of socialmedia sites include FACEBOOK®, FOURSQUARE®, TWITTER®, LINKEDIN®,INSTAGRAM®, PINTEREST®, TUMBLR®, REDDIT®, SNAPCHAT®, WHATSAPP®, FLICKR®,VK®, QZONE®, WECHAT®, and the like. Examples of affiliate or partnerwebsites include AMERICAN EXPRESS®, GROUPON®, LIVINGSOCIAL®, and thelike. Moreover, examples of mobile device communications includetexting, email, and mobile applications for smartphones.

Benefits, other advantages, and solutions to problems have beendescribed herein with regard to specific embodiments. However, thebenefits, advantages, solutions to problems, and any elements that maycause any benefit, advantage, or solution to occur or become morepronounced are not to be construed as critical, required, or essentialfeatures or elements of the disclosure. The scope of the disclosure isaccordingly limited by nothing other than the appended claims, in whichreference to an element in the singular is not intended to mean “one andonly one” unless explicitly so stated, but rather “one or more.”Moreover, where a phrase similar to ‘at least one of A, B, and C’ or ‘atleast one of A, B, or C’ is used in the claims or specification, it isintended that the phrase be interpreted to mean that A alone may bepresent in an embodiment, B alone may be present in an embodiment, Calone may be present in an embodiment, or that any combination of theelements A, B and C may be present in a single embodiment; for example,A and B, A and C, B and C, or A and B and C. Although the disclosureincludes a method, it is contemplated that it may be embodied ascomputer program instructions on a tangible computer-readable carrier,such as a magnetic or optical memory or a magnetic or optical disk. Allstructural, chemical, and functional equivalents to the elements of theabove-described various embodiments that are known to those of ordinaryskill in the art are expressly incorporated herein by reference and areintended to be encompassed by the present claims. Moreover, it is notnecessary for a device or method to address each and every problemsought to be solved by the present disclosure, for it to be encompassedby the present claims. Furthermore, no element, component, or methodstep in the present disclosure is intended to be dedicated to the publicregardless of whether the element, component, or method step isexplicitly recited in the claims. No claim element is intended to invoke35 U.S.C. § 112(f) unless the element is expressly recited using thephrase “means for” or “step for”. As used herein, the terms “comprises,”“comprising,” or any other variation thereof, are intended to cover anon-exclusive inclusion, such that a process, method, article, orapparatus that comprises a list of elements does not include only thoseelements but may include other elements not expressly listed or inherentto such process, method, article, or apparatus.

The invention claimed is:
 1. A method comprising: receiving, by aprocessor using the Digital Imaging and Communication in Medicine(DICOM) protocol, content from an IP address; storing, by the processor,the content in association with a sender identifier, in response to thesender being unknown; receiving, by the processor, a registration forthe sender identifier, subsequent to the receiving the content and thestoring the content; and transferring, by the processor using the DICOMprotocol, the content to an account associated with the senderidentifier, in response to the receiving the registration for the senderidentifier.
 2. The method of claim 1, wherein the content is a medicalimage.
 3. The method of claim 1, wherein the content is a medical imagethat is only viewable with DICOM viewer code.
 4. The method of claim 1,further comprising receiving, by the processor, the IP address.
 5. Themethod of claim 1, further comprising receiving, by the processor, aport number.
 6. The method of claim 1, further comprising receiving, bythe processor, the sender identifier.
 7. The method of claim 1, furthercomprising establishing, by the processor, a connection based on the IPaddress.
 8. The method of claim 1, further comprising establishing, bythe processor, a connection based on a port number.
 9. The method ofclaim 1, wherein the sender identifier is unknown based on the senderidentifier not being within a table of sender identifiers.
 10. Themethod of claim 1, further comprising comparing, by the processor, thesender identifier with a table of sender identifiers.
 11. The method ofclaim 1, wherein the sender identifier is at least one of an ApplicationEntity Title (AE Title), a sender email address, sender cell phonenumber or a sender social security number.
 12. The method of claim 1,wherein communications to overcome firewall and security settings arenot needed, prior to receiving the registration.
 13. An image accesssystem comprising: a processor; and a tangible, non-transitory memoryconfigured to communicate with the processor, the tangible,non-transitory memory having instructions stored thereon that, inresponse to execution by the processor, cause the processor to performoperations comprising: receiving, by the processor using the DigitalImaging and Communication in Medicine (DICOM) protocol, content from anIP address; storing, by the processor, the content in association with asender identifier, in response to the sender being unknown; receiving,by the processor, a registration for the sender identifier, subsequentto the receiving the content and the storing the content; andtransferring, by the processor using the DICOM protocol, the content toan account associated with the sender identifier, in response to thereceiving the registration for the sender identifier.
 14. The system ofclaim 13, further comprising receiving, by the processor, the senderidentifier.
 15. The system of claim 13, further comprising establishing,by the processor, a connection based on the IP address.
 16. The systemof claim 13, further comprising establishing, by the processor, aconnection based on a port number.
 17. The system of claim 13, whereinthe sender identifier is unknown based on the sender identifier notbeing within a table of sender identifiers.
 18. The system of claim 13,further comprising comparing, by the processor, the sender identifierwith a table of sender identifiers.
 19. The system of claim 13, whereinthe sender identifier is at least one of an Application Entity Title (AETitle), a sender email address, sender cell phone number or a sendersocial security number.
 20. An article of manufacture including anon-transitory, tangible computer readable storage medium havinginstructions stored thereon that, in response to execution by aprocessor, cause the processor to perform operations comprising:receiving, by the processor using the Digital Imaging and Communicationin Medicine (DICOM) protocol, content from an IP address; storing, bythe processor, the content in association with a sender identifier, inresponse to the sender being unknown; receiving, by the processor, aregistration for the sender identifier, subsequent to the receiving thecontent and the storing the content; and transferring, by the processorusing the DICOM protocol, the content to an account associated with thesender identifier, in response to the receiving the registration for thesender identifier.